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fact 



This investigation Undertaken to evaluate the 

effectiveness of the T^aci^ e ^'§ School Readiness Inventory (TSRI) , 
an empirically derived fi^^item questionnaire, in identifying 
at-risk or f ai lure-prone f^&ohool children. Four samples 
totalling 453 children, sC^^ned with the TSRI in the spring of 
either pre-kindergar te*j of kindergarten, were followed through 
the end of first grade, <ffle evidence showed, first, that scores 
on the TSRI produced a» a^ r ag e correlation of .58 with the 
children's performance acf^ss the first grade curriculum and, 
second, that the cutoff p<?*ht s on this inventory correctly 
identified 7396 to 90% 0 f ^°^e preschool children whose 
subsequent work in fir^t ^^de placed them at or near the bottom 
'1"H of the class while achieves an overall hit rate of 8696- 
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An Evaluation of a Mew Teacher Inventory to 
Identify the Fai lure-prone Preschool Child 

Marvin Simner , Ph.D. 
Department of Psychology 
University of Western Ontario 
London, Ontario N6A 5C2 

Since the 1970s there has been considerable interest 
throughout North America in establishing compensatory education 
programs to assist preschool children Who are at risk for early 
school failure (Casto & Mastropieri, 1986; Lazar & Darlington, 
i982; Wright, 1983). Because of budget restrictions, however, 
today it is often the pre -kindergarten or kindergarten teacher, 
instead of the psychologist or psychometrist , who must identify 
and then refer for placement, children who might profit from 
being in such programs ( Lichteristeih & Iretoh, 1984; Lindsay, 
1980; Lindsay & Wedell, 1982). This important role in screening 
that teachers now play is typically performed in the spring 
semester to allow ample time for teachers to become familiar with 
the children in their classes. Unfortunately, however, findings 
reported by Fletcher and Satz (1984) as well as Stevenson, 
Parker, Wilkinson, Hegion, and Fish (1976) suggest that even 
though teachers have an opportunity to become well acquainted 
with the children's day to day behaviors prior to screening, a 
teacher 9 s global Judgement of a preschool child* s learning 
potential might not be very accurate . In both investigations 



evidence was reported showing that only about 20£ of tixose 
children who subsequently experienced considerable &if?icxxity 
learning were correctly identified by their preschool dashers in 
the spring semester as children in need of special ^SsiSt^nce . 
In at least one sense though these findings come as no Surprise 
since work by Becker and Snider (1979) as well as Ki$ogfr, $chir, 
and Windeguth-Behn (1974) suggests that preschool t§&cHer$ often 
are uncertain when asked to list the characteristic^ that best 
describe the child with a possible learning handicap. 

To be sure, inventories or behavior checklists deigned to 
help preschool teachers improve the accuracy of thetr judgements 
in identifying at-risk children have been available fcs^ i&aiiy 
years (for examples see Crow, 1978; Nurss & McGauvr^, 1§76; 
Valett , 1974; Wallace & Larsen, 1978; Zeitlin, 1976). Most of 
these inventories, however, suffer from two major sh<?^t comings 
that could seriously hamper their usefulness in any gjOre^ning 
program. First, the vast majority contain anywhere from 40 to 
over 200 items that a teacher must complete in order to judge the 
academic potential of a given child. Hence, a teacher vfto 
decides to employ one of these devices could easily ^aquira a 
week or longer to screen a typical class of 25 child**an^time 
that most teachers simply cannot spare for this purpose even 
though they might be very aware of the importance of rtiaKin£ 
correct referral decisions. Second, and of far greater Concern, 
it is well known that many of these Inventories have nev^r been 
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properly validated (Levy & Goldstein, 1984; Lindsay, 1980). in 
fact, in a recruit review we reported that a large number of items 
frequently found on these inventores have little or no bearing oh 
later school performance (Simner , 1983). For instance, items 
that require a teacher to determine whether a preschool child 
knows the names of the body parts and their positions, knows left 
from right, or can walk a balance beam usually only produce 
correlations of around .20 with later school performance, 
correlations that simply are too low to be of any practical 
importance. Thus, if teachers draw upon items like these when 
deciding whether or not to refer a child, their decisions might 
very well be based on faulty information. 

During the course of preparing this review, however, we were 
able to locate five items which, when scored in the spring, 
normally produce correlations in the neighborhood of .50 with 
early school achievement (see Table 2 in Simner, 1983). To help 
rectify the shortcomings mentioned above we then proposed that if 
preschool teachers only refer children who perform poorly on an 
inventory composed of these items, they could have a reasonably 
accurate ?nd at the same time, an extremely rapid means for 
identifying the at-risk children in their classes. To examine 
this proposal we then developed the Teacher's School Readiness 
Inventory (TSRI ) , shown in Figure 1, which is composed of these 
five items and the scoring instructions given in Simner (1983). 
Hence, the major aim of the present longitudinal investigation 



was to evaluate the effectiveness of this new inventory in 
identifying children screened in the spring of pr e-kindergar ten 
and kindergarten who subsequently experienced difficulty 
mastering the first grade curriculum. 

Place Figure 1 about here 



Procedure 

Sub j ects 

To insure replicability we employed two independent samples 
of children at both the pr e-kindergar ten (N = 113) and 
kindergarten (N = 340) levels. All four samples were drawn from 
22 public elementary schools serving lower and middle income 
areas of London, Ontario, an urban center with a population of 
275,000. The children were obtained by distributing permission 
forms through the schools requesting parental approval to collect 
information on the children's behaviors in preschool and on the 
children's subsequent academic achievment . Approximately 70% of 
the permission forms were returned and, with few exceptions, all 
of these gave approval for the children to take part in this 
investigation . 

Telephone interviews were conducted wich a representative 
group of 103 parents for the purpose of collecting demographic 
information. The outcome of these interviews indicated that the 
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mean socio-economic index for the samples was 37.8 on the Blishen 
scale for Canadian occupations ( Blishen & McRoberts , 1976): In 
addition, according to the children's teachers -, whereas about 10% 
Of the children came from a bilingual background, all were fluent 
in English and all were in an age-appropriate grade (either pre- 
kindergarten or kindergarten) at the time the ratings were made. 

Sample #1 consisted of 45 pre-kindergar ten children (26 
male, 19 female) distributed among four classes and rated in 
March, 1983. Sample #2 contained 68 pre-kindergar ten children 
(39 male, 29 female) divided among seven classes and rated in 
March, 1984. Sample #3 was composed of 107 kindergarten children 
(52 male, 55 female) from seven classes. The ratings on these 
children were obtained in March, 1983. Finally, Sample #4 
involved 233 children (118 male, 115 female) divided 
among 15 classes and assigned ratings in March, 1984. The mean 
age of the pre-kindergar ten children when rated was 4 years, 8 
months while the mean age Of the kindergarten children was 5 
years, 9 months. Furthermore, all of the children were in 
attendance in the classes in which the ratings took place for 
periods ranging from two to six months prior to being rated by 
their teachers. 
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Method 

The children's teachers were asked to rate each child on all 
five items on the TSRI according to the instructions shown in 
Figure i. A total or composite score that ranged from 5 through 
25 for each child was then obtained by adding each of the sepa- 
rate ratings. The mean composite score for the pre-kindergarten 
children (Sample #1 and #2 combined) was 15.4 (SD = 4.6) whereas 
for the kindergarten children (Sample #3 and #4 combined) the 
mean composite score was 17.0 (SD = 4.5). 

Inter-rater reliability 

The most appropriate way to evaluate the inter-rater 
reliability of an instrument like the TSRI is to obtain 
independent ratings made at the same time of year by different 
teachers who are equally familiar with the children being rated. 
Unfortunately, few classes from which the children in our 
investigation were drawn had a teaching assistant who knew the 
children as well as the children's own teacher. This situation, 
of course, is common to all investigations of teacher inventories 
and, perhaps, is the reason why most other inventories contain no 
evidence on inter-rater reliability. 

However, we were able to obtain two ratings oh children 
attending eight of the classes. Each rating was made by the 
child's teacher and a teaching assistant who was equally familiar 
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with the child. To guard against the possiblity of bias, each 
rater was requested not to discuss her ratings with the other 
rater. When the TSRI forms were collected the raters were asked 
if they had complied with these instructions. Because one pair 
of raters failed to comply, the forms they submitted were 
excluded from the analysis. The final sample consisted of 
two ratings on 113 children obtained from seven pairs of raters. 

The results yeilded a product -moment correlation of .86 ( df 
= ill, p < . 001 ) between the pairs of total scores obtained from 
the two groups of raters. It is worth noting that the level of 
agreement indicated by this correlation is similar to that 
reported in the few studies dealing with teacher inventories 
where others also were able to gather information on inter-rater 
reliability (Feshback, Adelman, & Fuller, 1974; Lindsay, 1980; 
Novack, Bonaventura, & Merenda, 1973). 

Achievement Criteria 

The children in ail four samples were followed through the 
end of first grade. Henee, the pr e-kindergar ten children in 
Sample #1 and #2 were tracked for a period of two years while the 
kindergarten children in Sample #3 and #4 were tracked for a 
per iod of one year . 

Two different criteria were employed in evaluating the 
children * s academic performance . The first and major 
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criterion was chosen to Comply with many recent suggestions 
calling for the use of meaningful or realistic measures that 
reflect actual classroom work when evaluating research that is 
supposed to relate to school achievement (e.g., Lazar & 
Darlington, 1982). At the end of first grade we obtained the 
children's report card marks in reading, written composition, and 
arithmetic. These marks ranged oh a 12 point scale from D- to A+ 
and reflect the teacher's appraisals of the children's command 
of the core curriculum established by the board of education. To 
determine each child's overall in-class performance at the end of 
first grade we calculated an average mark for each child across 
these three subject areas. 

Because of the possibility that some of the first grade 
teachers who prepared these report cards might have been informed 
by the children's preschool teachers of the children's scores On 
the TSRI , it was considered useful to employ a second measure of 
achievement. Thus, in May of first grade we administered grade 
appropriate tests from both the Woodcock Reading Mastery Test 
(WRMT) by Woodcock (1974, Form-B) and the Keymath Diagnostic 
Arithmetic Test (KDAT) by Connolly, Nachtman, and Pritchett 
(1971) to approximately 85£ of the children in each sample. 
These particular instruments were chosen because they contain 
material actually taught in class and so permitted a further 
appraisal of the children's command of the core curriculum. 
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Moreover i since the first grade teachers had no knowledge of the 
children's scores on either instrument and the testers who 
administered these instruments were not aware of the preschool 
teacher's assessements on the TSRI or of the children's progress 
in class, we could be quite certain that, here, the predictor and 
criteria were indeed independent. 



Results 

Table 1 contains the product-moment correlations between the 
children's total scores on the TSRI obtained in pr e-kindergar ten 
(Sample #1 and #2) as well as in kindergarten (Sample #3 and #4) 
and the children's subsequent performance in first grade. 
(Although separate correlations were calculated for the males and 
females in each sample, no reliable sex differences were found 
and so this evidence is not reported.) As the results in this 
table indicate, independent of when the TSRI was administered, 
the sample of children to whom it was given, or the achievement 
measures used, the outcome was the same. For example, when in- 
class performance was the criterion the correlations ranged 
from .47 (Sample #2: first grade marks in math, df = 66, p < .001) 
to .64 (Sample #4: overall first grade performance, df = 225, 
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p < • 001 ) • When the criterion was achievement test performance 
the correlations extended from .52 (Sample #1: KDAT , df = 31, 
p < .001) through .65 (Sample #5: KDAT , df = 83 , p < .001). 
Furthermore* the correlations in Table 1 are very similar to the 
correlations reported by others using such psychometric screening 
devices as the McCarthy Scales of Children's Abilities (Funk, 
Sterner, & Green, 1986), the de Hirsch Predictive Index (Feshback, 
Adelman, & Fuller, 1974), and the Metropolitan Readiness Test 
(Server, Shapiro, & Shapiro, 1972,) to mention but a few (for 
reviews of the correlational validity of many psychometric 
screening instruments see Dykstra (1967) or Horn and Packard 
(1985)). 

In summary, this evidence suggests that the scores children 
receive on the TSRI , whether in the spring of pre-kindergarten or 
in the spring of kindergarten, are related to children's 
performance across the curriculum at the end of first grade. 
Furthermore, the correlations are comparable in magnitude to 
those obtained using the far more time consuming instruments that 
frequently have been recommended for general screening purposes. 

Place Table 1 about here 



In addition to knowing its correlational validity, it is 
equally important to determine if a screening device can be 
employed to separate preschool children whose subsequent school 
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achievement is well below average from other preschool children 
whose performance in school is considered acceptable. As a basis 
for making such a Judgement , the cutoff points typically 
recommended for use on standardized tests like the ones mentioned 
above, usually identify about 7096 to 75£ of children who later 
show serious learning problems (true positives). Moreover, with 
these cutoff points it is often possible to achieve overall 
classification hit rates (true positives + true negatives/total 
sample) in the vicinity of 80% (Mercer, Algozzine , & Trif iletti , 
1979). Therefore, if the TSRI is to be employed by preschool 
teachers for general screening purposes in place of standarized 
psychometric tests administered by psychometr ists or 
psychologists , it would seem necessary that the TSRI should 
achieve at least this standard of performance . 

First, employing Lindsay' s general procedure (Lindsay & 
Wedell, 1982) we selected as a cutoff point on the TSRI a total 
score equivalent to one standard deviation below ; the mean. This 
procedure resulted in a cutoff score of 11 at the pre- 
kindergarten level while at the kindergarten level the resulting 
cutoff score was 13. Children whose scores on the TSRI placed 
them either at or below these values were said to be at risk for 
failure , or in other words , to have a poor prognosis for school 
success. Children scoring above these points, on the other hand, 
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were not expected to have difficulty in school and therefore were 
said to have a good prognosis for school success. 

Next* following guidelines in Lichtenstein and Iretdri 
(1984), the children in all four samples were divided into three 
categories based on the children's overall performance in class 
at the end of first grade- Children whom we placed in the "poor 
performance" category were those who received an overall grade of 
D- , D, or D+ on the 12 point scale mentioned above. For the most 
part these children either were not promoted or, if promoted, 
were assigned by their teachers to a slower or Junior section of 
the second grade or were placed in some form of special education 
class because they were experiencing considerable difficulty 
learning. The second category labelled "satisfactory 
performance" refers to children whose overall mark was In the C 
range. Finally, the "good to excellent performance" category- 
contained children having marks in the B- to A+ range which, 
according to the children's teachers, indicated that the children 
were not experiencing any major problems mastering the core 
cur r iculm. 

Place Table 2 and Table 3 about here 

Table 2 contains the number and percentage of 
pre-kindergarten children (Sample #1 and #2) in the three 
classroom performance categories who Were above or below the 
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cutoff point of 11 oh the TSRI. Table 3 contains a similar 
breakdown but for the kindergarten children (Sample #3 and #4). 
As the findings in both tables indicate, again the outcome was 
nearly identical across the four samples . With a cutoff point of 
11 it was possible to correctly identify 73% to 9096 of the pre- 
kindergarten children in the poor performance category (true 
positives) and achieve a mean overall hit rate of 87%. At the 
kindergarten level, the cutoff point of 13 correctly identified 
80* to 85% of the children in this category while the hit rates 
here ranged from 82% to 87%. It is worth mentioning that 
although the TSRI scores received by the females were higher than 
those received by the males in both pre-kindergarten (female: M = 
16.75, male: M = 14.36; t = 2.81 , df = 111, p < .01) and in 
kindergarten (female: M = 17.81, male: M = 16.23; t = 3.08, df = 
337, p < .001), no improvement resulted when we took these 
differences into account and employed separate cutoff points for 
males and females. In essence, as was the case with the 
correlational evidence, when these results are compared to the 
hit rate findings reported by others (see the extensive 
literature reviews prepared by Mercer, Algozzine , and Trif iletti , 
1979, as well as Liechtenstein and Ireton, 1984), it can be seen 
that the TSRI is equally or more effective than many of the full- 
scale psychometric instruments that often are recommended for the 
purpose of identifying individual at-risk children. 
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Note also that the* fi»<U*igs we obtained through this further 
analysis of our data rep*>e g6 ht a decided improvement over the 
findings reported in the investigations by Fletcher and Satz 
(1984) and Stevenson, est. *1 , (1976) referred to above. Recall 
that in both investigations when preschool teachers were asked to 
Judge the at risk status of children in their classes based 
solely on their day to dajr &5ti Q ral observations of the 
children's in-class beh^v^or^* they correctly identified only 
about 2096 of those chiltfrsfi Vb. 0 subsequently experienced serious 
learning problems. In ^aix-t^St , by having the teachers 
confine their daily obs^rv-^iQns to the five items on the TSRI 
we were able to identify, Average, 82% of these children 
which is a four fold in^re^e in accuracy over the results 
reported by Fletcher and- S#*5 as well as Stevenson, et . al . . 



Ancillary Findings 
Because in some school districts teachers might be called 
upon to identify at-rislt cb tl d* e n earlier than the spring, it was 
considered important to k*^ ±T similar results could be obtained 
if the TSRI were to be used the fall semester. To this end we 
obtained teacher ratings Ob * further sample of 55 children in 
November of kindergarten- *V<s years later, at the end of 
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first grade, information was collected on the children's 
performance in school using the sets of criteria mentioned above. 
In line with our previous findings the correlations here ranged 
from .55 (WRMT: df = 49, p < •001) to .72 (report card marks in 
reading: df = 53, p < .001). Also, the hit rate analysis showed 
that with the same cutoff point that we employed before at the 
kindergarten level , we were able -to correctly identify 83# of the 
children whose subsequent classroom work placed them in the poor 
performance category, while at the same time achieving an overall 
hit rate of 76%. Therefore, it would seem that the TSRI might 
very well provide teachers with useful information about the at 
^isk status of a child long before that child even nears the end 
of a preschool year. 



Piseussion 

The main findings from this investigation support our 

previous claim (Simner , 1983) that if preschool teachers 

concentrate only on the five items shown on the TSRI they should 

have sufficient information to identify the majority of preschool 

children who are likely to need assistance before entering 
2 ___ _ _ _ 

school . As is the case with all inventories or behavior 

checklists , however , because the TSRI ratings depend on teacher * s 

subjective judgements it is possible that teachers in districts 

other than the one where we obtained our data might employ 
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slightly different standards in arriving at these j u^geui^hts - 

If so* these different standards could affect the cu^ofrf points 

referred to above since these cutoff points were chosen to 

correspond with scores 1 SD below the mean composite eocte^ 

obtained from the teachers in our sample. Therefore , i*i line 

with a recommendation made by Liechtenstein and Ireto^ (1984 ) as 

well as Salvia and Ysseldyke (1985), we suggest that loc^l cutoff 

points should be calculated and compared to the cutoff points 

mentioned above. If there is a discrepency between t^^e local 

cutoff points and our cutoff points then the local civto£f points 

should be employed when the TSRI is used elsewhere for 

3 

screening purposes . 
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Footnotes 

1 

The occasional discrepancies in samples sizes shown in 
Table 1 and in the Subjects section of this report resulted from 
a few children whose achievement test scores were available but 
whose report card marks were not because the children moved prior 
to the end of June. 

2 

Some possible reasons for the relationship between certain 
items on the TSRI and subsequent school achievement are given in 
Simner, 1982, 1985, 1986. Recommendations for assisting children 
who perform poorly on these items also can be found in these 
articles- 

3 

A manual to accompany the TSRI has detailed instructions 
for establishing local cutoff points as well as suggestions for 
intervention. For information on how to obtain a copy of this 
manual write to the author in care of the Department of 
Psychology, University of Western Ontario, London, Ontario N6A 
5C2. 
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Teacher's School 
Readiness inventory 



INDIVIDUAL RATING FORM 



Mame_ 



School 



Grade 



Date 



Total Score. 



^ : Using the ^point raflng scale shown below, rate the child on each of the following items. Record your 
ratings on the appropriate lines in the column to the right Add all of your ratings to obtain the child's total score. 



1} li^class distractibility, attention span and memor yjSRSn: Is the child easily distracted by other 

!, C . hiW *!f VC ^""y «membering and following instructions and remembering 
the details and content of material presented in class? 

Rating: l 2 3 4 5 

.. ^ h 'y , very good 

dis&acflb,e attention span 

2) Verbal fluency Does the child tend to use precise wor Is and convey abstract ideas reasonably well 
when asked to describe events? J 

Rating: 1 2345 

very good 
verbal fluency 

3) Interest and Rarticipatjon: Does the child show interest, enthusiasm, and eagerness to participate 
!" v^ous c assroom acuvities and does the child readily convey this overall sense of enthusiasm 
to other children or to adults? 



poor verbal 
fluency 



1 

very 
unenthusiastic 



3 



Bating: * n a 5 

very 
enthusiastic 

when ihown pictures of these letters one at a time in random order? ^ 
Rating: l 2 3 

0 to 15% about 25% about 50% 



4 _____ 
about 75% 



5 

85 to 100% 



5) Hffi!^^ does 
^ ^ overaU form of * Ue « and numbers by adding, deleting, or misaligning parts 
thereby Droducmi* fnrm »rmr_ that <_.._* *i~u~- »- t" Vx^^Z * 61 _ _ 6 » 



Rating: 



B 


| itiMHMir* 






§ P 0 U b - 


4- 




c 


G S UQ 


a 






ocp □ 


y 


Y nhL| _ 






z 




i : 


EH 


7 


a s c a e 1 


G 


fcG€e>6b- 


X 


^ ? a 3 


J 




4 


H * 


K 




5 
6 


t _ z a . — 


-L- 




9 ) PJ^ 


N 




? 





very often 



2 

often 



3 

occasionally 



4 

rarely 



5 

never 



CopyHlhI 0 SimiJ«PiM6 

all right* reserved 



Figure 1. The Teacher's School Readiness Inventory. 
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Table 1. Product-moment correlations between children's total scores, on the 
TSRI obtained in March of either Pre-Kiiidergarten (Sample #1 and #2) 
or kindergarten (Sample #3 and #4) and the children's subsequent 
performance in First Grade as measured using achievement tests and 
June report card marks. 



ACHIEVEMENT 
TESTS 



JUNE REPORT CARD MARKS 



WRMT KDAT READING WRITTEN MATH 

COMPOSITION 



OVERALL 
PERFORMANCE 



*** *** *** 

.53 .52 .62 

(N=33) (N=33) (N-44) 



*** *** *** 

.53 .58 .63 

(N=44) (N=44> (N=44) 



SAMPLE 
#1 

PRE-K. 



*** *** *** 

SAMPLE .58 .56 .59 

#2 (N=60) (N=60) (N=68) 



*** *** *** 

SAMPLE .62 .65 .58 

#3 (N=85) (N=85) (N-107) 

KINDER. 



*** *** *** 

SAMPLE .59 .57 .61 

#4 (N=191) (N=189) (N=227) 



*** *** *** 

.49 .47 .59 

(N=68) (N=68) (N=68) 



*** *** *** 

.57 .50 .61 

(N=107) (N=107) (N=107) 



*** *** *** 

.59 .58 .64 

(N=227) (N=227) (N=227) 



*** 

P < .001 

1 Woodcock Reading Mastery Test 

2 

Keymath Diagnostic Arithmetic Test 
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Prediction of children's overall in-class performance at the end of 
First Grade from TSRI total scores obtained by the children in Marc] 
of Pre-kindergarten 



SAMPLE #1 (N = 44) 

poor satisfactory good-excellent 

performance performance performance 

POOR PROGNOSIS (true positive) (false positive) (false positive) 

(TSRI total score 

of ri or less) § 4 1 

(90%) (25%) (6%) 

GOOD PROGNOSIS (false negative) (true negative) (true negative) 

(TSRI total score 

of 12_ or more) 1 12 17 

(10%) (75%) (94%) 

Hit Rate = 9 + 12 + 17 38- 

44 = 44 = 86% 

SAMPLE #2 (N « 68) 

poor satisfactory good-excellent 

performance performance performance 

POOR PROGNOSIS (true positive) (false positive) (false positive) 

(TSRI total. score 

of 11 or less) 8 6 0 

(73%) (18%) (0%) 

GOQD_ PROGNOSIS (false negative) (true negative) (true negative) 

(TSRI total score 

of 12_ or more) 3 28 23 

(27%) (82%) (100%) 

Hit Rate =8+28+23 59 -- 
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Prediction of children's overall in-class performance at the end of 
First Grade from TSRI total scores obtained by the children in March 
of kindergarten 



SAMPLE #3 (N = 107} 

poor satisfactory good-excellent 

performance performance performance 

POOR PROGNOSIS (true positive) (false positive) (false positive) 
(TSRI total score 

of 13^ or less) 17 11 5 

(85%) (30%) (10%) 

GOOD PROGNOSIS (false negative) (true negative) (true negative) 

(TSRI total score 

of or more) 3 26 45 

(15%) (70%) (90%) 

Hit Rate = 17 + 26 + 45 _ ^88 _ 

107 ~ 107 " 2% 



SAMPLE #4 (N = 227) 

poor satisfactory good-excellent 

performance performance performance 

POOR PROGNOSIS (true positive) (false positive) (false positive) 
(TSRI total score 

of 13_ or less) 28 18 5 

(80%) (19%) (5%) 

GOOD PROGNOSIS (false negative) (true negative) (true negative) 
(TSRI total score 

of 14. or more) 7 76 93 

(20%) (91%) (95%) 

Hit Rate = 28+76+93 _ -- 
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